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THE NATIONAL CENTER MISSION STATEMENT ~ 


The National Center for Research in Vocational Education's mission 
is to increase the ability of diverse agencies, institutions, and organi- 
zations to solve educational problems relating ‘to individual career 
planning, preparation, and progression. The National Center fulfills 
its mission by: 

* Generating knowledge through research 

* Developing educational programs and products 

* Evaluating individual program needs and outcomes 

* Installing educational programs and products 

* Operating information systems and services 


* Conducting leadership development and training programs 
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The study reported herein was performed pursuant to 
a contract (#400-77-0700) from the National Institute of 
Education. The opinions expressed herein do not neces- 
sarily reflect the position or policy of the National 
Institute of Education, and no official endorsement by 
the National Institute of Education should be inferred. 


The National Center for Research in Vocational Educa- 
tion does not discriminate against any individual because 
of race, color, creed, or sex. 
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FOREWORD 


Interpreting outcomes of vocational education is a 
major concern of teachers, administrators, members of 
advisory councils, and policy members for vocational educa 
tion at all levels. The concern focuses on interpreting 
outcomes of vocational education in response to the require- 
ments and intent of the Education Amendments of 1976 and to 
the need for viable vocational education programs and ser- 
vices to prepare individuals for employment. 


The National Institute of Education recognized the con- 
fusion surrounding the interpretation of current vocational 
education outcome data and contracted with the National Center 
to examine the interpretability of the data and examine other 
outcome measures. This summary of the final report of the 
project "Interpreting Outcome Measures in Vocational Education" 
provides a brief description of the project findings. 


Recognition for their efforts are due to many persons 
including the project staff of Floyd L. McKinney, project 
director; Kenney E. Gray, research specialist; Marie Abram, 
graduate research associate; and Roseann Pavlick, secretary; 
the evaluation division staff including N. L. McCaslin, 
associate director and former acting project director; Jerry 
Walker, former associate director; Stephen Franchak, research 
specialist; and other staff of the National Center for 
Research in Vocational Education. Significant contributions 
to the conduct of the project were also made by Robert Stump, 
project officer, The National Institute of Education; the 
national advisory committee for the project; Grant Venn, 

Mary Kievit, and Donald Drewes who prepared commissioned 
papers; Robert Billings who wrote a chapter of the handbook, 
Vocational Education Measures: Instruments to Survey Former 
Students and Their Employers; and Robert Morgan, George 

Copa, and John Jennings who joined the previously mentioned . 
individuals in giving presentations at the national conference | 
conducted by the project staff. The National Center is 
especially indebted to the many local and state vocational 
educators who participated in the case study portion of the 
project. 


Robert E, Taylor 

Executive Director 

The National Center for 
Research in Vocational 
Education 
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INTERPRETING OUTCOME MEASURES 
IN VOCATIONAL EDUCATION 


PROBLEM AND BACKGROUND 


The overarching problem for the project was the inter- 
pretability of vocational education outcome data. 


The problem of interpreting data on the impact of 
vocational education has been persistent and multifaceted. 
Congressional staff members, the National Advisory Council 
for Vocational Education and numerous other agencies have 
expressed concern about the interpretability of vocational 
education outcome data. 


The reasons for difficulties in interpreting vocational 
education outcome data are numerous. Various reports have 
indicated there are problems of definitions, problems of 
communication, and problems of handling data. Also, there 
is a lack of documentation concerning the processes used to 
collect job placement data. 


Many studies have expressed concern about the virtual 
impossibility of clearly interpreting data on the outcomes of 
vocational education. At the core of this problem is the 
lack of commonly accepted standard definitions of: 

(1) the vocational student; (2) relatedness of training to 
employment; (3) job performance (employers' views of 

former vocational students); and (4) job satisfaction (former 
students' views of their occupational and other life roles). 


For "vocational studént" and "relatedness," the 


SS major definitional--and subsequent, interpretability--issues 


stem from seemingly inconsistent and incomplete use of the 


‘terms as operationally applied by state and local education 
“agencies. The problems with "job performance" and "job 
satisfaction" stem not so much from inconsistent usage as 

.. from a dearth of measurement tools and processes by which 
“one could even begin to grasp their operational meaning. 


The project objectives and strategies evolved from the 


preceding problems. The project objectives were developed 
and the strategies were desiqned to determine the 
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effects of the inconsistent and incomplete uses of 
“vocational student" and "relatedness" on interpretability 
and to begin to understand the complexities of measuring 
"job performance" and "job satisfaction." 


OBJECTIVES 
The project objectives were as follows: 

1. To verify inconsistent usage of the terms "vocational 
student" and "relatedness" among local vocational educa- 
tion agencies and state vocational education agencies. 

2. To determine how different definitions of "vocational 
student" and "relatedness" might effect the interpre- _ 
tability of vocational education impact data (e.g., 
reported percentages of vocational students finding 
related employment after training) by using existing 
data bases. 


3. To synthesize the current literature and approaches 
measuring "job satisfaction" and job performance." 


4. To prepare a handbook on vocational education measures. 


5. To prepare position papers on the socio-political issues 
underlying the interpretability issue. 


6. To share and discuss the results of objectives 1, 2, 3, 
4, and 5 by means of a national conference. 


7. To maintain contact with agencies with whom the project 
can contribute and benefit. 
GENERAL PLAN OF OPERATION 
The following strategies and activities were used to 
accomplish the project objectives. 
o Use of a project advisory committee. 
o Liaison with other agencies and groups. 


o Case study of factors contributing to differences 
in placement rates. 


o Commissioned papers. 


o A National Conference on Outcome Measures for 
Vocational Education. 


© Development of a handbook on vocational education 
measures. 


The results of these strategies and activities are 
briefly described on the following pages. More detailed 
information appears in the Final Report. 


ANALYSIS OF EXTANT DATA BASES 
IN VOCATIONAL EDUCATION 


In keeping with the intent of the Request for Proposal 
by the National Institute of Education and with the project 
objectives an attempt was made to locate a data base which 
would allow the investigators to vary the definitions of 
"vocational student" and "relatedness" to demonstrate what 
mMicht happen to placement rates. 


To conduct such an analysis would have required that 
the following student information be available in the data 
base. 


1. Data on the vocational program in which a student 
is enrolled coded by USOE program codes. 


2. Data on current occupation coded by the number of 
the DOT job title. 


3. Teacher or student judgment of relatedness of 
training to employment (e.g., related, somewhat 
related, unrelated). 


4. A computerization of the information included in 


Matching Occupational Classifications to Vocational 
Education Program Codes. 


In most data bases students were classified as ei her 
vocational, general or college preparatory. Generally 
students were not coded by USOE program codes and if they 
were, they usually included only the first two digits. No 
information was included relative to the length of time 
students spend in vocational classes. Current dccupations 
were generally not included but were reported as related, 
somewhat related, or not related. 
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Most of the data bases identified were connected with 
studies conducted for other purposes. As such, it was not 

feasible to expect that the data could be manipulated using 

yet another design. 


Most data bases have relied on teacher reported data 
from each classroom. Although teachers would be expected 
to report information honestly, certain variations would 
normally be anticipated due to the varying interpretations 
made from the original questions. 


It was not possible to identify an existing data base } 
for secondary analysis. Therefore, a case study was con- 
ducted in selected state and local education agencies to 
identify reasons for the wide discrepancies in placement ! 
rates reported by states. 


CASE STUDY OF DIFFERENCES IN . 
JOB PLACEMENT RATES REPORTED BY STATES 


Case Study Questions 


The overall purpose of the case study was to identify : 
and describe the factors associated with the differences in " 
job placement rates in field trained and related fields as 
reported by states. The specific questions addressed were: | 


1. What (e.g., delivery system for vocational educa- ; 
tion, organizational structure for vocational 
education, level and sources of financial support ; 
for vocational education, attitudes toward 
evaluation, etc.) can be identified as contributing 
to the differences in job placement rates in field 
trained and related fields? 


2. How do the definitions of the terms vocational . 
education and dropout, completer, leaver and + 
relatedness contribute to the differences in job 
placement rates in field trained and related fields? 4 

i 
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3. What processes of collecting placement data can 
be identified as contributing to the differences Y 
in job placement rates in field trained and : | 
related fields? 


4. How does the operation of a placement service 
contribute to the differences in job placement rates 
in field trained and related fields? 


i ot eed ER Ne le iy Pete BS er) ee 2) Pre pore oe eee ea) Oe a eee ee ae ye ey CS ee ee ee ee 


5. How does the utilization of placement data contri- 
bute to the differences in job placement rates in 
field trained and related fields? 


The study was designed to concentrate in those areas 
for which vocational educators may have more control and/or 
influence. 


Sample Design 


By uSing Project Baseline data for 1975, two pools of 
states were determined: two states were selected with high job 
placement rates and two states were selected with low job 
placement rates. In addition, one state was selected near 
the median of all states. The selection of states also 
took into consideration such factors as: (a) region or 
geographic location, (b) urban/rural character of the state, 
(c) state population rankina, and (d) size of state vocational 
education staff. Two local education agencies were selected 
in each state on the basis of: (1) placement data collection 
efforts, (2) size of agency, (3) size of vocational education 
procram, and (4) proximity to the state vocaticnal education 
agency. Personnel were interviewed in the five state voca- 
tional education agencies, two local vocational education 
agencies in each of the five states and representatives in 
the U.S. Office of Education. 


In the conclusions of the study, states with high place- 
ment rates are identified as States A and B. The state with 
placement rates in the nedian range is identified as State 
C. States D and E had low placement rates. 


Conclusions 


Personnel at all levels within all five states viewed 
the collection of placement data as primarily a compliance 
effort. In States A and E, the effort was viewed as com- 
pliance with both federal and state regulations. In three 
states, State B, C, and D, the compliance was viewed as 
reaction to the federal mandate. Interviewees at the federal 
level also believed that the state data were being collected 
primarily as a compliance effort. 


It was assumed that collecting data primarily in response 
to a mandate would weaken the incentive of personnel involved 
in the effort. This appeared to be the case in all of the 
states. Interviewees at the state vocational education agency 
believed the placement data could be used for general decision 
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making and program improvement. It appeared that greater 
effort could be made to use the placement data in all of the 
states. 


With no consistent use of the placement data and with 
compliance serving as the major impetus for its collection, 
placement data were not collected systematically with an 
emphasis on precision and accuracy. State E reports monitoring 
its data collection process. All.of the other states did 
mimimum monitoring or evaluating of their data collection 
processes. In these states only a brief review of the data 
was. made as it was submitted to the state vocational educa- 
tion agency. Federal interviewees expressed concern over 
the lack of auditable records at the local vocational educa- 
tion level. 


Interviewees in all states and at the federal level ex- 
pressed concern for the reliability and validity of the place- 
ment data. This concern with the quality of the data took 
the form of questioning its accuracy due to: 


‘1. the room for accidental slippage 
2. the room for purposeful slippage 
3. the lack of systematic procedures 


4. lack of information on students not able to be 
located 


5. collection of the data during the former student's 
final year on the job when job changes are frequent. 


Closely tied to the quality of the data was the wide 
variety of sophistication of personnel and data processing 
equipment among the states. State B reported using hand 
calculators to process their data. The other states used 


. data processing equipment but had varying degrees of coopera~ — 

- tion with the department in which the data processing equip-_ ee 

..ment was housed. The. federal. interviewers confirmed this = 

-. wide range of sophistication and believed it to be a major. 

-:.. variable accounting for differences in the: ragcuracy OE 
‘placement: data: among. states. 


In only: one state, State ‘E, haa specific: financial. 


Oo puageete been allocated to the follow-up. procedure. The: 
other states added: the responsibility ‘of the follow-up. “a os 
Bendy. to. personnel assigned other major peeponsshatiticeys fo 


Lack of finances to hire additional personnel and: provide 
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inservice workshops to increase the expertise of present 
personnel appeared to limit the ability of the states to 
provide better quality data. Federal interviewees con- 
firmed this lack of adequate funding as a source of poor 
quality data. é 


The state vocational education agency generally functioned 
in an advisory capacity in the collection of placement data. 
State E was the exception in that it had considerable state 
level coordination. None of the states had a written policy 
‘for the follow-up process. 


The placement data were disseminated differently in 

the various states. State D collected data beyond that re- 

quired by the U.S. Office of Education. These data were 

reported in a major document that contrasted sub-groups of 

students over the past several years. This report was widely 
., disseminated throughout the state and local vocational educa- 

tion agencies. States B and C did not prepare any report be- 

yond completing the U.S. Office of Education form. Distribu- 
tion of the U.S. Office of Education form in these states 

was very selective. 


States A and E prepared a summary report which they 
disseminated widely throughout the state and local vocational 
education agencies. States D and E also made area and local 
data available. State E used workshops as another form of 
dissemination. . 


Differences in High and Low Placement States 


‘The previous discussion concerned the general situation 
found in all five of the states. Individual states that 
did not fit within the general picture were specifically men- 
tioned, The following four conclusions were based on the > 
_ findings of the study where low Sandan states differed from 
high, BIACemeny states: 


Se yale Pasties re See a Ads, 


Jee ep, tes 


te. AS Tew: placement. states had a : Higher’ sropoketon: of 
(4s the secondary. school students enrolled in. 

... . vocational education. ‘The:low placement, states 

 yeported approximately forty. percent ef the.:... 

“Secondary population enrolled in. vocational . eS, JES ee es 

- . education. whereas approximately one-third of Erg ee Be 4 ; 

the secondary population of the high placement 

pB he “states was. ‘enrolled in vocational education... 


Pg the process of ‘collecting placement data was 
NOE By eremay te. in the" low, placement; J States. when » 


| compared to the. high placement. states. 


tae, <Low placement states: collected placement data 
_ by way of a mail survey directly to. the. former | 

J). student whereas high bidcesinnt states, used 
/ teacher’ collected data. ee 


4... Low placement states: hada narrower | ‘definition 
. «of "completers" than’ high. placement states. “High am 
placement states included students who left. the . 
program. before ‘completion but found work .in.a. 


related field as’ ‘completers, ‘whereas; Low. Placement 


Vag aatates did nk 


5. Both. of. the’ low. piadement eeabay: ‘ane the middle. 
_ placement state ‘provided ‘placement. data feedback — 
‘to the. area, and local SOMERTON: agencies. 


The tnvormuedlon provided in ‘Table 1 denorte: Senda in con= 
sistency among the states. The reader should be.aware of 
“these trends and ‘not: accept, ‘them ‘as: absolutes: or statements. 
OF cause and effect. 


‘Suggested Research Hypotheses 

a “Phe following. research hypotheses. were generated by’, 

baie peaiack ‘staff in ‘relationship to the study questions. 
“These shypotheses were’ generated as a result of the case «© 
“study. findings in the five states and should form the basis 


_ £or: planning additional study. These hypotheses represent 
ideas about what the next research steps mone ‘Be. Conner ng 


vocational education placement data. 


ae A state! 's ‘reputed. placement rates. will Scovenas 
“ag the state implements:a more ote. eercaene 
~ data collection’ REQGER SD: ; 


te eS a, state! s. reported placement. rate will dectexte ag 


- the individuals responsible for collecting and 

.. reporting the data view. the. effort more as.infor- — 

--<.mation to: be’ used: for” Peparee improvement, ‘rather - 
. than’ pPBL Lanse et A gh ree 4 5 


| Otis. a consistent set of definitions’ for the key. terms 
“0 regarding. placement data. is developed there will 
oY) pera Gecrease’ in 1 ERE ‘state’ s inact piscenent: a, 
“rates : : \ i Peeaee ea Dive 


i a i i $ aloe? “4 2 < & lays 
ef i ali, hy . i my ON Co , : ' : ’ : i 
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Afi te be a ae ; a eh ee “ee tse eS 
 Rapebecants! of Collect Ing, Reporting suit Using . ag." a? 
Placement Data in the Case Study. States*: 


‘ 

_ ; ge gee ea Pa ts sss MRENDS TOWARD CONSISTENCY . 

a y coe eee: ee: ' of Middle = —- Between © 
_ 4 2 ae _... Issue Areas: | so... Between Between Placement High and | 

ek a oe eee Le an, t % ee High. Low .—._ State_with — Low 

| _ #83 a“ Pee ae a e's oe a Placement. ‘Placement: ‘High . Low Placement 

i ti a ae eR ee wo States: States _ “ ‘States States ‘States 

ee ee DEFINITIONS OF KEY TERMS: 


Comparison of. Official Definitions with 
Those in Actual. Use ” ae! kc. eo Pp ke lh, Gad Gina eset tet a 
Student. : . Mag Yes ' P¥es....°:, Yes!” Yes. -' Yes! .:: 
Completer'::| 0.7. oe ee Mew oo Wee iat Ne: oe | No: Yes 
leavers Ps, z " No "at No Oe Noe. NO “No. - 
Dropout | hie fe eae eo : 4 ee, “a Now: "NG 
Occupational Titles» eo aR pe Ee he, aN a Or, en Ns a NE Oe NE ie Pig ait 
_ Relatedness | 5 h) apyat wits 4 yh, NG WG eNOS Nor Nol So 


Influences Contributing to ) the. Formation 3 , ie wig Bag SP ae Fy he. he Wy ig ats ee 
of Definitions . oe ; ak: eee. ee Yea." .*i '¥Yes.. ° Yea. - Yes. 


Strategies Used to Conmunicate Definitions: 4. -2 co ey PAD oer 
of Key Terms’ y we ; ‘ ‘Yess Yes... o Yes’. Yes Yes 


Monitoring and Evaluating the Use of ee og ae ee EES oat ae Le een, 
pestis a Sah * ho . so toe Nee! "  Yede Oo" Yes” ves Yes ‘Shae & 


PROCESS OF COLLECTING PLACEMENT DATA. 


General Processes Used in Planning and. : an ee a ee Tile Caine a ak 
Conducting Placement Studies _ ee ee Nor, 0, No-' | Nov’ No- 


State Policies Concerning Placement Studies No ; | a “No No No 
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Table 1, Continued 


Yes 


TRENDS TOWARD. CONSISTENCY . 


; . af a of Middle 
Issue Areas Between Between = Placement High. and 
High Low State with Low 
Placement Placement High Low Placement. 
States States States States _ States ae 
- State Guidelines for Planning and Conducting | ; . Pa ga 
.. Placement Studies Yes No No | ‘No No 
"Assistance Available for Planning and 
ae Conducting Placement Studies Yes No Yes No- No 
“Roles and Responsibilities for Conducting j 
Placement Studies Yes No Yes Now No 
Resource Allocations for Placement Studies Yes No Yes No Ne 
External Influences Affecting Placement : 
- ' Studies Yes No. Yes No No. 
: “Monitoring and Evaluating Study Efforts Yes No Yes No No. 
"Problems Yes Yes ‘Yes Yes Yes 
Planned Changes No: No No No No- 
“UTILIZATION OF.PLACEMENT DATA 
“Compliance of Program Improvement Yes Yes Yes Yes Yes 
"Dissemination Efforts of the Various States No: Yes No No No 
Uses Made of Placement Data Yes Yes Yes Yes Yes 
Problems Yes” Yes 
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4 . 4 ce or a: Table 1, Cont Inued 
a AL ccc CCC LLL LA : —— 
i TRENDS TOWARD CONSISTENCY 
a v of Middle. © Between. 
. Issue Areas Between Between. Placement High and 
7 ee High Low State: with Low 
Eggi, atte | Placement Placement High Low Placement 
: 2. ; rte States _-_ States States States States 
? os i fae : : : : I 
) PLACEMENT FUNCTION 
ae go 3 7 Agency Philosophical Position Concerning 
aoe re » “the Placement Function Yes Yes Yes Yes Yes 

State Coordination for the Placement - 3 

Function Yes Ne Yes No No 
Fey doe he Placement Services Provided Yes . Yes Yes Yee Vee Oo 
a i Spee 2 aaa 
a Resource Allocation for Placement Services Yes No Yes No No ' 
Fae: \ 4 ‘ : ‘ 
; 
k | os Nature. and Extent of Cooperation with x i: 
a ae ee Other Agencies No No No No Yr ee 
Zz ite 8 _ - Problems Yes No Yes No No 
OR ee ee a EE 
Be wf ag eke ‘The information provided in Table 1 reports trends in consistency among the states. The reader, 
i o* « ; ‘should be aware of these trends and not accept them as absolutes or statements of cause and effect. 
Qe 
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Sug ested Guidelines for Using Placement Data as Reported 
“oo ‘py States 


‘ Based on the findings of the case study the following 
‘guidelines are suggested for use by those individuals and 
groups using vocational education placement data reported by 

-.,- states. 

~“gonstrued to be specific to a given state. They should be 

'. oused as a set of cautions to observe when using placement 

‘, ‘data as it is currently being reported. 


ee 


A state's reported placement rate will decrease as 
the state develops more specific policies, quidelines, 
and instructions. 


A state's reported placement rate will decrease as 
the state implements placement data collection 
strategies that use the former student as the 
primary source. of information. 


A state's reported placement rate will increase 


as the state implements a comprehensive and 
systematic placement system for current and former 
vocational education students. 


A state's reported placement rate will decrease as 
the attitude toward collecting placement data 
reflects one of collecting data for program improve- 
ment rather than collecting data to be in epme Liane 
with federal, state, and local regulations. 


A state's reported placement rate will increase as 
the percentage of vocational education students 
enrolled in cooperative programs increases. 


A state's reported placement rate will increase 
as the local vocational teachers' commitment for 
placing students increases. 


These guidelines are general and should not be 


Users of placement data should be very cautious 
when using placement data to make comparisons within 
and among states because of the numerous ways in 
which key terms. are defined. 


Users of placement data should be aware of the 


original source of the data, since there tends to 


be some difference in the way critical items are 
interpreted by former students in contrast to 
teachers or administrators. 
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Users of placement data should not automatically 
fault a vocational education program solely on the 
basis of placement rates. 


4. Users of placement data should be aware of the 
placement services offered by the agencies from 
which they are using placement data since agencies 
with more highly developed placement services tend 
to have higher placement rates. 


5. Users of placement data should determine whether or 
not the reported data include responses from 
graduates of vocational education programs and from 
non-graduates of vocational education programs. 


6. Users of placement data should be aware that in most 
instances the data have not been verified. 


7. Users of placement data should recognize that the 


job reported for a former student is but a step in 
the individual's total career path. 


COMMISSIONED PAPERS 


Three major papers were commissioned. The papers 
-addressed issues underlying the concerns of the project. 
The papers and the authors were: 


1. Perspectivism in Choosing and Interpreting Outcome 
Measures in Vocational Education - Mary Kievit 


2. Outcome Standardization for Compliance or Direction: 
The Critical Distinction «+ Donald Drewes 


ge Criteria Against Which Vocational Education Should 
Be Held Accountable - Grant Venn 


ge It is possible that the commissioned papers will be 
- available on a cost-recovery basis from the National Center 
. for Research in Vocational Education. 


NATIONAL CONFERENCE 


One hundred-twenty vocational educators and other 
» interested individuals attended the National Conference on 
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Outcome Measures for Vocational Fducation, August 16-18, 
1978 at the Galt House in Louisville, Kentucky. The con- 
ference focused on the commissioned papers mentioned above. 
In addition, the following major topics were considered. 


1. A National Problem: Interpreting Outcome Measures 
in Vocational Education - Robert Morgan 


2. Evaluatina Vocational Fducation: A Congressional 
Perspective - John Jennings 


3. Concepts and Complexities of Measuring Job Satis- 
faction and Job Performance - Robert Billings 


4. Instruments for Measuring Job Satisfaction and Job 
Performance - Kenney Gray 


5. Analysis of Extant Data Bases in Vocational Education 
-~ N. L. teCaslin 


6. Case Study of Differences in Job Placement Rates 
Reported in States - Floyd McKinney 


The conference participants, through small group sessions, 
provided reactions to the presentations. 


VOCATIONAL EDUCATION MEASURES: INSTRUMENTS 
TO SURVEY FORMER STUDENTS AND THEIR FMPLOYERS 


A handbook of instruments on (1) job satisfaction, (2) 
job performance, (3) former student's percevtion of vocational 
training, and (4) employer's perception of student's vocational 
training was prepared. The handbook provides the practitioner 
with abstracts of instruments, copies of instruments, and a 
suacested method of choosing an instrument that fits the 
practitioner's purpose. ‘Considerable attention is aiven to 
the concepts and complexities of measuring the four categories 
of instruments included in the handbook. 


For each instrument review in the handbook, the following... 
information is included in the abstract: (1) title of 5 
instrument, (2) developer of instrument, (3) data, (4) siaii 

.. ability, (5) description of instrument, (6) administration, 

“: (7) test: data, and (8) general comments. 


‘It is possible that the handbook will be available on 


- a cost-recovery basis from the National Center for Research 
in Vocational Education. 
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CONCLUSIONS 


id The following conclusions are based on the total scope of 
project activities. 


° 


Vocational education program outcomes need to be 
closely linked to the values of individuals and 


groups concerned with and interested in vocational 
“education. 


The originators of data concerning the outcomes of 


“vocational education, the local education agencies, 


7 must be the primary users of the data in order for 


ultimate improvements in vocational education 
to result. 


If the data are useful to the provider of data, e.g., 
local administrators and teachers, then efforts will 
be put forth as necessary to collect accurate data. 


At the time of this study, extant data bases did not 
include sufficient information to permit an 
investigation of the effects of differing definitions 
on placement rates. 


In general, placement data are not collected system- 
atically with an emphasis on precision and accuracy. 


‘Most vocational educators question the reliability 


and validity of placement data. 


There is a wide range of sophistication among personnel 
and data processing equipment concerning placement data 
collection at the state and local levels. 


Quality of instruction, relevance of program, impact 
of program, and individual transition and growth 
represent four broad categories of possible criteria 
for which vocational education might be held 
accountable. 


The variables which affect the quality of job 


performance are many, making it difficult to discern 


-- the effects of even very good vocational education. 


However, by (1) measuring dimensions of performance 


which are important for a given job and (2) measuring 


those variables which affect performance--motivation, 
skills, and role concept--a useful and understandable 


evaluation can be performed. 
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© Intrinsic motivation, job involvement, and beliefs 
ree ee ae about work are attitudes deserving increased 
ma te attention by evaluators in vocational education. 


o The-effects of vocational education on job satis- 
faction are very complex and difficult to determine. 
By uSing three models of satisfaction (Lawler's 
component model, job/person fit, and met expectations), 
the effects of vocational education on job satisfaction 
can be studied and possibly analyzed. 


RECOMMENDATIONS 


[ftir as o. | As a result of the findings of the project, the following 
* a met oA qepomandations are made. 


o A continuing effort should be undertaken to ascertain 
the values expected of vocational education's various 
audiences and how vocational education could achieve 
appropriate linkage with these values. 


o A major research effort should be planned and con- 
ducted to identify realistic criteria for which 
vocational education should be held accountable. 


©o Personnel development efforts should be initiated 
for preparing and updating vocational education 
personnel concerning the collection and use of 
placement data. 


